COMPAR-EU Recommendations on Self-Management Interventions in Type 2 Diabetes Mellitus.

Self-management interventions (SMIs) offer a promising approach to actively engage patients in the management of their chronic diseases. Within the scope of the COMPAR-EU project, our goal is to provide evidence-based recommendations for the utilisation and implementation of SMIs in the care of adult individuals with type 2 diabetes mellitus (T2DM). A multidisciplinary panel of experts, utilising a core outcome set (COS), identified critical outcomes and established effect thresholds for each outcome. The panel formulated recommendations using the Grading of Recommendations, Assessment, Development, and Evaluations (GRADE) approach, a transparent and rigorous framework for developing and presenting the best available evidence for the formulation of recommendations. All recommendations are based on systematic reviews (SR) of the effects and of values and preferences, a contextual analysis, and a cost-effectiveness analysis. The COMPAR-EU panel is in favour of using SMIs rather than usual care (UC) alone (conditional, very low certainty of the evidence). Furthermore, the panel specifically is in favour of using ten selected SMIs, rather than UC alone (conditional, low certainty of the evidence), mostly encompassing education, self-monitoring, and behavioural techniques. The panel acknowledges that, for most SMIs, moderate resource requirements exist, and cost-effectiveness analyses do not distinctly favour either the SMI or UC. Additionally, it recognises that SMIs are likely to enhance equity, deeming them acceptable and feasible for implementation.

Characteristics and impact of interventions to support healthcare providers' compliance with guideline recommendations for breast cancer: a systematic literature review.

BACKGROUND: Breast cancer clinical practice guidelines (CPGs) offer evidence-based recommendations to improve quality of healthcare for patients. Suboptimal compliance with breast cancer guideline recommendations remains frequent, and has been associated with a decreased survival. The aim of this systematic review was to characterize and determine the impact of available interventions to support healthcare providers' compliance with CPGs recommendations in breast cancer healthcare. METHODS: We searched for systematic reviews and primary studies in PubMed and Embase (from inception to May 2021). We included experimental and observational studies reporting on the use of interventions to support compliance with breast cancer CPGs. Eligibility assessment, data extraction and critical appraisal was conducted by one reviewer, and cross-checked by a second reviewer. Using the same approach, we synthesized the characteristics and the effects of the interventions by type of intervention (according to the EPOC taxonomy), and applied the GRADE framework to assess the certainty of evidence. RESULTS: We identified 35 primary studies reporting on 24 different interventions. Most frequently described interventions consisted in computerized decision support systems (12 studies); educational interventions (seven), audit and feedback (two), and multifaceted interventions (nine). There is low quality evidence that educational interventions targeted to healthcare professionals may improve compliance with recommendations concerning breast cancer screening, diagnosis and treatment. There is moderate quality evidence that reminder systems for healthcare professionals improve compliance with recommendations concerning breast cancer screening. There is low quality evidence that multifaceted interventions may improve compliance with recommendations concerning breast cancer screening. The effectiveness of the remaining types of interventions identified have not been evaluated with appropriate study designs for such purpose. There is very limited data on the costs of implementing these interventions. CONCLUSIONS: Different types of interventions to support compliance with breast cancer CPGs recommendations are available, and most of them show positive effects. More robust trials are needed to strengthen the available evidence base concerning their efficacy. Gathering data on the costs of implementing the proposed interventions is needed to inform decisions about their widespread implementation. TRIAL REGISTRATION: CRD42018092884 (PROSPERO).

Good or best practice statements: proposal for the operationalisation and implementation of GRADE guidance.

An evidence-based approach is considered the gold standard for health decision-making. Sometimes, a guideline panel might judge the certainty that the desirable effects of an intervention clearly outweigh its undesirable effects as high, but the body of supportive evidence is indirect. In such cases, the application of the Grading of Recommendations, Assessment, Development and Evaluations (GRADE) approach for grading the strength of recommendations is inappropriate. Instead, the GRADE Working Group has recommended developing ungraded best or good practice statement (GPS) and developed guidance under which circumsances they would be appropriate.Through an evaluation of COVID-1- related recommendations on the eCOVID Recommendation Map (COVID-19.recmap.org), we found that recommendations qualifying a GPS were widespread. However, guideline developers failed to label them as GPS or transparently report justifications for their development. We identified ways to improve and facilitate the operationalisation and implementation of the GRADE guidance for GPS.Herein, we propose a structured process for the development of GPSs that includes applying a sequential order for the GRADE guidance for developing GPS. This operationalisation considers relevant evidence-to-decision criteria when assessing the net consequences of implementing the statement, and reporting information supporting judgments for each criterion. We also propose a standardised table to facilitate the identification of GPS and reporting of their development. This operationalised guidance, if endorsed by guideline developers, may palliate some of the shortcomings identified. Our proposal may also inform future updates of the GRADE guidance for GPS.

The GIN-McMaster guideline tool extension for the integration of quality improvement and quality assurance in guidelines: a description of the methods for its development.

BACKGROUND AND OBJECTIVES: Our objective was to develop an extension of the widely used GIN-McMaster Guideline Development Checklist and Tool for the integration of quality assurance and improvement (QAI) schemes with guideline development. METHODS: We used a mixed-methods approach incorporating evidence from a systematic review, an expert workshop and a survey of experts to iteratively create an extension of the checklist for QAI through three rounds of feedback. As a part of this process, we also refined criteria of a good guideline-based quality indicator. RESULTS: We developed a 40-item checklist extension addressing steps for the integration of QAI into guideline development across the existing 18 topics and created one new topic specific to QAI. The steps span from 'organization, budget, planning and training', to updating of QAI and guideline implementation. CONCLUSION: The tool supports integration of QAI schemes with guideline development initiatives and it will be used in the forthcoming integrated European Commission Initiative on Colorectal Cancer. Future work should evaluate this extension and QAI items requiring additional support for guideline developers and links to QAI schemes.

Analytical frameworks in colorectal cancer guidelines: development of methods for systematic reviews, their application and practical guidance for their use.

OBJECTIVES: Analytical frameworks are graphical representation of the key questions answered by a systematic review and can support the development of guideline recommendations. Our objectives were to a) conduct a systematic review to identify, describe and compare all analytical frameworks published as part of a systematic and guideline development process related to colorectal cancer (CRC), and b) to use this case study to develop guidance on how to conduct systematic reviews of analytical frameworks. METHODS: We developed a search strategy to identify eligible studies in Medline and Embase from 1996 until December 2020. We also manually searched guideline databases and websites to identify all guidelines and systematic reviews in CRC that used an analytical framework. We assessed the quality of the guidelines using the Appraisal of Guidelines for Research and Evaluation II tool. The systematic review was registered in International Prospective Register of Systematic Reviews, registration CRD42020172117. RESULTS: We screened 34,505 records and identified 1,166 guidelines and 3,127 systematic reviews on CRC of which five met our inclusion criteria. These five publications included four analytical frameworks in colorectal cancer (one update). We also describe our methodological approach to systematic reviews for analytical frameworks and underlying concepts for developing analytical framework using a bottom-up or top-down approach. CONCLUSION: Few guidelines and systematic reviews are utilizing analytical frameworks in the development of recommendations. Development of analytical frameworks should begin with a systematic search for existing analytical frameworks and follow a structured conceptual approach for their development to support guideline recommendations. Our methods may be helpful in achieving these objectives.

The ecosystem of health decision making: from fragmentation to synergy.

Clinicians, patients, policy makers, funders, programme managers, regulators, and science communities invest considerable amounts of time and energy in influencing or making decisions at various levels, using systematic reviews, health technology assessments, guideline recommendations, coverage decisions, selection of essential medicines and diagnostics, quality assurance and improvement schemes, and policy and evidence briefs. The criteria and methods that these actors use in their work differ (eg, the role economic analysis has in decision making), but these methods frequently overlap and exist together. Under the aegis of WHO, we have brought together representatives of different areas to reconcile how the evidence that influences decisions is used across multiple health system decision levels. We describe the overlap and differences in decision-making criteria between different actors in the health sector to provide bridging opportunities through a unifying broad framework that we call theory of everything. Although decision-making activities respond to system needs, processes are often poorly coordinated, both globally and on a country level. A decision made in isolation from other decisions on the same topic could cause misleading, unnecessary, or conflicted inputs to the health system and, therefore, confusion and resource waste.

Which actionable statements qualify as good practice statements In Covid-19 guidelines? A systematic appraisal.

OBJECTIVES: To evaluate the development and quality of actionable statements that qualify as good practice statements (GPS) reported in COVID-19 guidelines. DESIGN AND SETTING: Systematic review . We searched MEDLINE, MedSci, China National Knowledge Infrastructure (CNKI), databases of Grading of Recommendations Assessment, Development and Evaluation (GRADE) Guidelines, NICE, WHO and Guidelines International Network (GIN) from March 2020 to September 2021. We included original or adapted recommendations addressing any COVID-19 topic. MAIN OUTCOME MEASURES: We used GRADE Working Group criteria for assessing the appropriateness of issuing a GPS: (1) clear and actionable; (2) rationale necessitating the message for healthcare practice; (3) practicality of systematically searching for evidence; (4) likely net positive consequences from implementing the GPS and (5) clear link to the indirect evidence. We assessed guideline quality using the Appraisal of Guidelines for Research and Evaluation II tool. RESULTS: 253 guidelines from 44 professional societies issued 3726 actionable statements. We classified 2375 (64%) as GPS; of which 27 (1%) were labelled as GPS by guideline developers. 5 (19%) were labelled as GPS by their authors but did not meet GPS criteria. Of the 2375 GPS, 85% were clear and actionable; 59% provided a rationale necessitating the message for healthcare practice, 24% reported the net positive consequences from implementing the GPS. Systematic collection of evidence was deemed impractical for 13% of the GPS, and 39% explained the chain of indirect evidence supporting GPS development. 173/2375 (7.3%) statements explicitly satisfied all five criteria. The guidelines' overall quality was poor regardless of the appropriateness of GPS development and labelling. CONCLUSIONS: Statements that qualify as GPS are common in COVID-19 guidelines but are characterised by unclear designation and development processes, and methodological weaknesses.

Defining decision thresholds for judgments on health benefits and harms using the Grading of Recommendations Assessment, Development and Evaluation (GRADE) Evidence to Decision (EtD) frameworks: a protocol for a randomised methodological study (GRADE-THRESHOLD).

INTRODUCTION: The Grading of Recommendations Assessment, Development and Evaluation (GRADE) and similar Evidence to Decision (EtD) frameworks require its users to judge how substantial the effects of interventions are on desirable and undesirable people-important health outcomes. However, decision thresholds (DTs) that could help understand the magnitude of intervention effects and serve as reference for interpretation of findings are not yet available.The objective of this study is an approach to derive and use DTs for EtD judgments about the magnitude of health benefits and harms. We hypothesise that approximate DTs could have the ability to discriminate between the existing four categories of EtD judgments (Trivial, Small, Moderate, Large), support panels of decision-makers in their work, and promote consistency and transparency in judgments. METHODS AND ANALYSIS: We will conduct a methodological randomised controlled trial to collect the data that allow deriving the DTs. We will invite clinicians, epidemiologists, decision scientists, health research methodologists, experts in Health Technology Assessment (HTA), members of guideline development groups and the public to participate in the trial. Then, we will investigate the validity of our DTs by measuring the agreement between judgments that were made in the past by guideline panels and the judgments that our DTs approach would suggest if applied on the same guideline data. ETHICS AND DISSEMINATION: The Hamilton Integrated Research Ethics Board reviewed this study as a quality improvement study and determined that it requires no further consent. Survey participants will be required to read a consent statement in order to participate in this study at the beginning of the trial. This statement reads: You are being invited to participate in a research project which aims to identify indicative DTs that could assist users of the GRADE EtD frameworks in making judgments. Your input will be used in determining these indicative thresholds. By completing this survey, you provide consent that the anonymised data collected will be used for the research study and to be summarised in aggregate in publication and electronic tools. PROTOCOL REGISTRATION NUMBER: NCT05237635.

A taxonomy and framework for identifying and developing actionable statements in guidelines suggests avoiding informal recommendations.

OBJECTIVE: To propose a taxonomy and framework that identifies and presents actionable statements in guidelines. STUDY DESIGN AND SETTING: We took an iterative approach reviewing case studies of guidelines produced by the World Health Organization and the American Society of Hematology to develop an initial conceptual framework. We then tested it using randomly selected recommendations from published guidelines addressing COVID-19 from different organizations, evaluated its results, and refined it before retesting. The urgency and availability of evidence for development of these recommendations varied. We consulted with experts in research methodology and guideline developers to improve the final framework. RESULTS: The resulting taxonomy and framework distinguishes five types of actional statements: formal recommendations; research recommendations; good practice statements; implementation considerations, tools and tips; and informal recommendations. These statements should respond to a priori established criteria and require a clear structure and recognizable presentation in a guideline. Most importantly, this framework identifies informal recommendations that differ from formal recommendations by how they consider evidence and in their development process. CONCLUSION: The identification, standardization and explicit labelling of actionable statements according to the framework may support guideline developers to create actionable statements with clear intent, avoid informal recommendations and improve their understanding and implementation by users.

Benefits and harms of annual, biennial, or triennial breast cancer mammography screening for women at average risk of breast cancer: a systematic review for the European Commission Initiative on Breast Cancer (ECIBC).

BACKGROUND: Although mammography screening is recommended in most European countries, the balance between the benefits and harms of different screening intervals is still a matter of debate. This review informed the European Commission Initiative on Breast Cancer (BC) recommendations. METHODS: We searched PubMed, EMBASE, and the Cochrane Library to identify RCTs, observational or modelling studies, comparing desirable (BC deaths averted, QALYs, BC stage, interval cancer) and undesirable (overdiagnosis, false positive related, radiation related) effects from annual, biennial, or triennial mammography screening in women of average risk for BC. We assessed the certainty of the evidence using the GRADE approach. RESULTS: We included one RCT, 13 observational, and 11 modelling studies. In women 50-69, annual compared to biennial screening may have small additional benefits but an important increase in false positive results; triennial compared to biennial screening may have smaller benefits while avoiding some harms. In younger women (aged 45-49), annual compared to biennial screening had a smaller gain in benefits and larger harms, showing a less favourable balance in this age group than in women 50-69. In women 70-74, there were fewer additional harms and similar benefits with shorter screening intervals. The overall certainty of the evidence for each of these comparisons was very low. CONCLUSIONS: In women of average BC risk, screening intervals have different trade-offs for each age group. The balance probably favours biennial screening in women 50-69. In younger women, annual screening may have a less favourable balance, while in women aged 70-74 years longer screening intervals may be more favourable.

Preoperative breast magnetic resonance imaging in patients with ductal carcinoma in situ: a systematic review for the European Commission Initiative on Breast Cancer (ECIBC).

OBJECTIVE: To evaluate the impact of preoperative MRI in the management of Ductal carcinoma in situ (DCIS). METHODS: We searched the PubMed, EMBASE and Cochrane Library databases to identify randomised clinical trials (RCTs) or cohort studies assessing the impact of preoperative breast MRI in surgical outcomes, treatment change or loco-regional recurrence. We provided pooled estimates for odds ratios (OR), relative risks (RR) and proportions and assessed the certainty of the evidence using the GRADE approach. RESULTS: We included 3 RCTs and 23 observational cohorts, corresponding to 20,415 patients. For initial breast-conserving surgery (BCS), the RCTs showed that MRI may result in little to no difference (RR 0.95, 95% CI 0.90 to 1.00) (low certainty); observational studies showed that MRI may have no difference in the odds of re-operation after BCS (OR 0.96; 95% CI 0.36 to 2.61) (low certainty); and uncertain evidence from RCTs suggests little to no difference with respect to total mastectomy rate (RR 0.91; 95% CI 0.65 to 1.27) (very low certainty). We also found that MRI may change the initial treatment plans in 17% (95% CI 12 to 24%) of cases, but with little to no effect on locoregional recurrence (aHR = 1.18; 95% CI 0.79 to 1.76) (very low certainty). CONCLUSION: We found evidence of low to very low certainty which may suggest there is no improvement of surgical outcomes with pre-operative MRI assessment of women with DCIS lesions. There is a need for large rigorously conducted RCTs to evaluate the role of preoperative MRI in this population. KEY POINTS: • Evidence of low to very low certainty may suggest there is no improvement in surgical outcomes with pre-operative MRI. • There is a need for large rigorously conducted RCTs evaluating the role of preoperative MRI to improve treatment planning for DCIS.

Contextual differences considered in the Tunisian ADOLOPMENT of the European guidelines on breast cancer screening.

BACKGROUND: Breast cancer is a common disease in Tunisia and is associated with high mortality rates. The "Instance Nationale de l'Evaluation et de l'Accréditation en Santé" (INEAS) and the Tunisian Society of Oncology decided to develop practice guidelines on the subject. While the development of de novo guidelines on breast cancer screening is a demanding process, guideline adaptation appears more appropriate and context sensitive. The objective of this paper is to describe the adaptation process of the European Guidelines on Breast Cancer Screening and Diagnosis to the Tunisian setting in terms of the methodological process, contextual differences between the source and adoloped guideline, and changes in the recommendations. METHODS: We used the 'Grading of Recommendations Assessment, Development and Evaluation' (GRADE)-ADOLOPMENT methodology to prioritize the topic, select the source guideline, and prioritize the questions and the outcomes. Once the source guideline was selected-the European Breast Cancer Guidelines-the European Commission´s Joint Research Centre shared with the project team in Tunisia all relevant documents and files. In parallel, the project team searched for local studies on the disease prevalence, associated outcomes' baseline risks, patients' values and preferences, cost, cost-effectiveness, acceptability, and feasibility. Then, the adoloping panel reviewed the GRADE evidence tables and the Evidence to Decision tables and discussed whether their own judgments were consistent with those from the source guideline or not. They based their judgments on the evidence on health effects, the contextual evidence, and their own experiences. RESULTS: The most relevant contextual differences between the source and adoloped guidelines were related to the perspective, scope, prioritized questions, rating of outcome importance, baseline risks, and indirectness of the evidence. The ADOLOPMENT process resulted in keeping 5 out of 6 recommendations unmodified. One recommendation addressing "screening versus no screening with ultrasound in women with high breast density on mammography screening" was modified from 'conditional against' to 'conditional for either' due to more favorable ratings by the adoloping panel in terms of equity and feasibility. CONCLUSION: This process illustrates both the feasibility of GRADE-ADOLOPMENT approach and the importance of consideration of contextual evidence. It also highlights the value of collaboration with the organization that developed the source guideline.

Digital breast tomosynthesis compared to diagnostic mammographic projections (including magnification) among women recalled at screening mammography: a systematic review for the European Commission Initiative on Breast Cancer (ECIBC).

BACKGROUND: Diagnostic mammography projections (DxMM) have been traditionally used in the assessment of women recalled after a suspicious screening mammogram. Digital breast tomosynthesis (DBT) reduces the tissue overlap effect, thus improving image assessment. Some studies have suggested DBT might replace DxMM with at least equivalent performance. OBJECTIVE: To evaluate the replacement of DxMM with DBT in women recalled at screening. METHODS: We searched PubMed, EMBASE, and the Cochrane Library databases to identify diagnostic paired cohort studies or RCTs comparing DBT vs DxMM, published in English that: reported accuracy outcomes, recruited women recalled for assessment at mammography screening, and included a reference standard. Subgroup analysis was performed over lesion characteristics. We provided pooled accuracy estimates and differences between tests using a quadrivariate model. We assessed the certainty of the evidence using the GRADE approach. RESULTS: We included ten studies that reported specificity and sensitivity. One study included 7060 women while the remaining included between 52 and 738 women. DBT compared with DxMM showed a pooled difference for the sensitivity of 2% (95% CI 1%-3%) and a pooled difference for the specificity of 6% (95%CI 2%-11%). Restricting the analysis to the six studies that included women with microcalcification lesions gave similar results. In the context of a prevalence of 21% of breast cancer (BC) in recalled women, DBT probably detects 4 (95% CI 2-6) more BC cases and has 47 (95%CI 16-87) fewer false-positive results per 1000 assessments. The certainty of the evidence was moderate due to risk of bias. CONCLUSION: The evidence in the assessment of screen-recalled findings with DBT is sparse and of moderate certainty. DBT probably has higher sensitivity and specificity than DxMM. Women, health care providers and policymakers might value as relevant the reduction of false-positive results and related fewer invasive diagnostic procedures with DBT, without missing BC cases.

Benefits and harms of breast cancer mammography screening for women at average risk of breast cancer: A systematic review for the European Commission Initiative on Breast Cancer.

OBJECTIVES: Mammography screening is generally accepted in women aged 50-69, but the balance between benefits and harms remains controversial in other age groups. This study systematically reviews these effects to inform the European Breast Cancer Guidelines. METHODS: We searched PubMed, EMBASE and Cochrane Library for randomised clinical trials (RCTs) or systematic reviews of observational studies in the absence of RCTs comparing invitation to mammography screening to no invitation in women at average breast cancer (BC) risk. We extracted data for mortality, BC stage, mastectomy rate, chemotherapy provision, overdiagnosis and false-positive-related adverse effects. We performed a pooled analysis of relative risks, applying an inverse-variance random-effects model for three age groups (<50, 50-69 and 70-74). GRADE (Grading of Recommendations Assessment, Development and Evaluation) was used to assess the certainty of evidence. RESULTS: We identified 10 RCTs including 616,641 women aged 38-75. Mammography reduced BC mortality in women aged 50-69 (relative risk (RR) 0.77, 95%CI (confidence interval) 0.66-0.90, high certainty) and 70-74 (RR 0.77, 95%CI 0.54-1.09, high certainty), with smaller reductions in under 50s (RR 0.88, 95%CI 0.76-1.02, moderate certainty). Mammography reduced stage IIA+ in women 50-69 (RR 0.80, 95%CI 0.64-1.00, very low certainty) but resulted in an overdiagnosis probability of 23% (95%CI 18-27%) and 17% (95%CI 15-20%) in under 50s and 50-69, respectively (moderate certainty). Mammography was associated with 2.9% increased risk of invasive procedures with benign outcomes (low certainty). CONCLUSIONS: For women 50-69, high certainty evidence that mammography screening reduces BC mortality risk would support policymakers formulating strong recommendations. In other age groups, where the net balance of effects is less clear, conditional recommendations will be more likely, together with shared decision-making.

Guideline-based quality assurance: a conceptual framework for the definition of key elements.

BACKGROUND: In 2017, the European Commission's Joint Research Centre (JRC) started developing a methodological framework for a guideline-based quality assurance (QA) scheme to improve cancer quality of care. During the first phase of the work, inconsistency emerged about the use of terminology for the definition, the conceptual underpinnings and the way QA relates to health questions that are answered in guidelines. The objective of this final of three articles is to propose a conceptual framework for an integrated approach to guideline and QA development and clarify terms and definitions for key elements. This work will inform the upcoming European Commission Initiative on Colorectal Cancer (ECICC). METHODS: A multidisciplinary group of 23 experts from key organizations in the fields of guideline development, performance measurement and quality assurance participated in a mixed method approach including face-to-face dialogue and several rounds of virtual meetings. Informed by results of a systematic literature review that indicated absence of an existing framework and practical examples, we first identified the relations of key elements in guideline-based QA and then developed appropriate concepts and terminology to provide guidance. RESULTS: Our framework connects the three key concepts of quality indicators, performance measures and performance indicators integrated with guideline development. Quality indicators are constructs used as a guide to monitor, evaluate, and improve the quality of the structure, process and outcomes of healthcare services; performance measures are tools that quantify or describe measurable elements of practice performance; and performance indicators are quantifiable and measurable units or scores of practice, which should be guided by guideline recommendations. CONCLUSIONS: The inconsistency in the way key terms of QA are used and defined has confused the field. Our conceptual framework defines the role, meaning and interactions of the key elements for improving quality in healthcare. It directly builds on the questions asked in guidelines and answered through recommendations. These findings will be applied in the forthcoming ECICC and for the future updates of ECIBC. These are large-scale integrated projects aimed at improving healthcare quality across Europe through the development of guideline-based QA schemes; this will help in implementing and improving our approach.

Bringing two worlds closer together: a critical analysis of an integrated approach to guideline development and quality assurance schemes.

BACKGROUND: Although quality indicators are frequently derived from guidelines, there is a substantial gap in collaboration between the corresponding parties. To optimise workflow, guideline recommendations and quality assurance should be aligned methodologically and practically. Learning from the European Commission Initiative on Breast Cancer (ECIBC), our objective was to bring the key knowledge and most important considerations from both worlds together to inform European Commission future initiatives. METHODS: We undertook several steps to address the problem. First, we conducted a feasibility study that included a survey, interviews and a review of manuals for an integrated guideline and quality assurance (QA) scheme that would support the European Commission. The feasibility study drew from an assessment of the ECIBC experience that followed commonly applied strategies leading to separation of the guideline and QA development processes. Secondly, we used results of a systematic review to inform our understanding of methodologies for integrating guideline and QA development. We then, in a third step, used the findings to prepare an evidence brief and identify key aspects of a methodological framework for integrating guidelines QA through meetings with key informants. RESULTS: Seven key themes emerged to be taken into account for integrating guidelines and QA schemes: (1) evidence-based integrated guideline and QA frameworks are possible, (2) transparency is key in clearly documenting the source and rationale for quality indicators, (3) intellectual and financial interests should be declared and managed appropriately, (4) selection processes and criteria for quality indicators need further refinement, (5) clear guidance on retirement of quality indicators should be included, (6) risks of an integrated guideline and QA Group can be mitigated, and (7) an extension of the GIN-McMaster Guideline Development Checklist should incorporate QA considerations. DISCUSSION: We concluded that the work of guideline and QA developers can be integrated under a common methodological framework and we provided key findings and recommendations. These two worlds, that are fundamental to improving health, can both benefit from integration.

Recommendations from the European Commission Initiative on Breast Cancer for multigene testing to guide the use of adjuvant chemotherapy in patients with early breast cancer, hormone receptor positive, HER-2 negative.

BACKGROUND: Predicting the risk of recurrence and response to chemotherapy in women with early breast cancer is crucial to optimise adjuvant treatment. Despite the common practice of using multigene tests to predict recurrence, existing recommendations are inconsistent. Our aim was to formulate healthcare recommendations for the question "Should multigene tests be used in women who have early invasive breast cancer, hormone receptor-positive, HER2-negative, to guide the use of adjuvant chemotherapy?" METHODS: The European Commission Initiative on Breast Cancer (ECIBC) Guidelines Development Group (GDG), a multidisciplinary guideline panel including experts and three patients, developed recommendations informed by systematic reviews of the evidence. Grading of Recommendations Assessment, Development and Evaluation (GRADE) Evidence to Decision frameworks were used. Four multigene tests were evaluated: the 21-gene recurrence score (21-RS), the 70-gene signature (70-GS), the PAM50 risk of recurrence score (PAM50-RORS), and the 12-gene molecular score (12-MS). RESULTS: Five studies (2 marker-based design RCTs, two treatment interaction design RCTs and 1 pooled individual data analysis from observational studies) were included; no eligible studies on PAM50-RORS or 12-MS were identified and the GDG did not formulate recommendations for these tests. CONCLUSIONS: The ECIBC GDG suggests the use of the 21-RS for lymph node-negative women (conditional recommendation, very low certainty of evidence), recognising that benefits are probably larger in women at high risk of recurrence based on clinical characteristics. The ECIBC GDG suggests the use of the 70-GS for women at high clinical risk (conditional recommendation, low certainty of evidence), and recommends not using 70-GS in women at low clinical risk (strong recommendation, low certainty of evidence).

Challenges in applying the GRADE approach in public health guidelines and systematic reviews: a concept article from the GRADE Public Health Group.

BACKGROUND AND OBJECTIVE: This article explores the need for conceptual advances and practical guidance in the application of the GRADE approach within public health contexts. METHODS: We convened an expert workshop and conducted a scoping review to identify challenges experienced by GRADE users in public health contexts. We developed this concept article through thematic analysis and an iterative process of consultation and discussion conducted with members electronically and at three GRADE Working Group meetings. RESULTS: Five priority issues can pose challenges for public health guideline developers and systematic reviewers when applying GRADE: (1) incorporating the perspectives of diverse stakeholders; (2) selecting and prioritizing health and "nonhealth" outcomes; (3) interpreting outcomes and identifying a threshold for decision-making; (4) assessing certainty of evidence from diverse sources, including nonrandomized studies; and (5) addressing implications for decision makers, including concerns about conditional recommendations. We illustrate these challenges with examples from public health guidelines and systematic reviews, identifying gaps where conceptual advances may facilitate the consistent application or further development of the methodology and provide solutions. CONCLUSION: The GRADE Public Health Group will respond to these challenges with solutions that are coherent with existing guidance and can be consistently implemented across public health decision-making contexts.